Search AI Products and News

Stability AI Japan has recently launched two remarkable Japanese language models, named 'Japanese Stable LM3B-4E1T' and 'Japanese Stable LM Gamma7B'. These models are built upon previously released English language models and have been pre-trained with a large amount of Japanese and English data to enhance their Japanese language processing capabilities. The two models consist of 3 billion and 7 billion parameters respectively, allowing for commercial use.

The Japanese government collaborates with tech giants such as NEC, Fujitsu, and SoftBank to invest hundreds of millions in developing a culturally sensitive Japanese language model. The new model will be trained on the national supercomputer Fugaku, boasting at least 30 billion parameters, with performance expected to significantly outshine existing models. The goal is to address shortcomings of current models in the Japanese market, such as generating rare characters and culturally inappropriate communication norms. Researchers have developed the Rakuda ranking system to assess the model's sensitivity to Japanese culture, with GPT-3.5 currently ranking first. The Japanese government also...